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Abstract  -  Due  in  part  to  the  very  high  flexibility  of  image 
contrast,  the  applications  of  magnetic  resonance  imaging 
(MRI)  continue  to  grow.  Advances  in  data  acquisition  speed, 
as  facilitated  by  MRI  physics,  have  provided  the  motivation  for 
specific  real-time  techniques.  For  useful  and  broad  implemen¬ 
tation  this  has  required  that  real-time  signal  processing  meth¬ 
ods  be  used.  In  this  work  the  principal  elements  of  a  real-time 
MRI  system  are  reviewed,  major  signal  processing  techniques 
presented,  and  several  contemporary  applications  discussed. 
Further  improvements  in  computational  speed  will  allow  in¬ 
creased  sophistication  in  real-time  MRI  techniques  in  the  fu¬ 
ture. 

I.  Introduction 

Since  the  time  of  its  initial  development  approximately 
20  years  ago,  magnetic  resonance  imaging  (MRI)  has  be¬ 
come  a  commonly  used,  widely  accepted  diagnostic  medical 
imaging  modality.  Worldwide  the  installed  base  is  over 
10,000  systems,  and  approximately  100,000  patient  exami¬ 
nations  are  performed  per  day.  Although  a  number  of  clini¬ 
cal  uses  for  MRI  were  identified  early  on,  such  as  for  imag¬ 
ing  of  the  brain  and  spine,  the  applications  of  MRI  have  ex¬ 
panded  considerably,  such  as  for  imaging  of  the  muscu¬ 
loskeletal  and  cardiovascular  systems.  Over  this  20  year 
timeframe  MRI  has  also  undergone  considerable  technical 
development,  with  major  advances  in  the  MRI  hardware  as 
well  as  the  manner  in  which  the  data  are  collected  and  im¬ 
ages  formed. 

Compared  to  other  medical  imaging  modalities  such  as 
x-ray  imaging  and  ultrasound,  MRI  in  general  has  longer 
image  acquisition  times.  Early  “spin-echo”  sequences  re¬ 
quired  times  as  long  as  10  minutes  or  more  to  obtain  the 
data  for  a  single  cross-sectional  “slice.”  In  the  last  15  years 
a  number  of  advances  in  the  MR  imaging  physics  have  al¬ 
lowed  considerable  reductions  in  this  time.  These  include 
echo-planar  imaging  (initially  developed  in  the  1970s  [1] 
but  shown  as  clinically  feasible  a  decade  later  [2]),  limited 
flip  angle  gradient  echo  imaging  [3],  multiple  phase- 
encoded  spin-echo  imaging  (sometimes  called  RARE  or 
fast-spin-echo)  [4].  Many  variants  of  these  techniques  have 
also  been  developed. 

As  the  acquisition  times  have  been  progressively  re¬ 
duced  in  MRI,  so  has  the  manner  in  which  MRI  is  used 
clinically  been  expanded.  For  example,  the  ability  to  obtain 
high  quality  images  within  a  20  second  time  interval  allows 
acquisition  during  breathholding,  and  this  can  allow  imag¬ 
ing  of  the  thorax  and  abdomen  without  the  image  degrada¬ 
tion  due  to  respiration. 

Additional  distinguishing  characteristics  of  MRI  com¬ 


pared  to  other  modalities  are  the  highly  variable  contrast  as 
well  as  the  ability  to  image  slices  of  arbitrary  size  and  orien¬ 
tation.  This  high  degree  of  flexibility  in  image  appearance, 
coupled  with  the  ability  to  acquire  images  in  decreasingly 
smaller  times,  has  raised  the  possibility  of  allowing  the  user 
to  perform  MR  imaging  on  an  interactive  basis.  In  principle 
this  can  allow  the  user  to  view  the  anatomy  of  interest  in 
real  time  and  adjust  the  scanning  parameters  in  a  manner 
specific  to  the  patient.  To  do  this  effectively  requires  real¬ 
time  processing  of  the  MR-related  signals  at  various  steps  in 
the  image  formation  process. 

II.  System  overview 

The  term  “real  time”  can  be  inteipreted  many  different 
ways  in  considering  imaging  systems,  generally  in  terms  of 
number  of  images  per  second.  In  this  work  this  is  not  speci¬ 
fied  as  some  fixed  number,  but  rather  it  is  assumed  that  the 
process  of  data  acquisition  and  image  formation  is  matched 
to  the  time  scale  of  the  phenomenon  under  study. 

Real-time  MRI  systems  are  comprised  of  three  major 
elements:  (i)  a  high  speed  data  acquisition  method;  (ii) 
means  for  reconstruction  of  the  data  into  an  image;  and  (iii) 
means  for  alteration  of  the  data  acquisition  on  the  basis  of 
the  reconstructed  data. 

The  first  of  these,  data  acquisition,  is  determined  by  the 
MRI  physics.  A  specific  pulse  sequence  is  used,  such  as  the 
above-mentioned  echo-planar,  gradient  echo,  or  fast-spin- 
echo,  as  dictated  by  the  desired  image  contrast,  spatial  reso¬ 
lution,  and  immunity  to  various  artifacts.  The  acquisition 
times  for  continuous  imaging  of  an  individual  slice  can  be 
the  order  of  several  tens  of  msec  for  echo-planar  methods, 
hundred  msec  for  gradient  echo,  and  one  second  for  fast- 
spin-echo  techniques.  An  additional  possibility  is  the  imag¬ 
ing  of  a  single  line  or  pencil  through  the  subject,  and  this 
can  be  done  at  rates  as  high  as  50  Hz  [5].  Alternatively,  it  is 
possible  to  image  along  a  simple  k-space  trajectory,  such  as 
a  circle  [6],  in  order  to  determine  specific  information  for 
some  application.  Details  of  many  of  the  contemporary 
pulse  sequences  which  can  be  used  for  the  high  speed  imag¬ 
ing  in  general  are  provided  in  the  recent  literature  [7]. 

Images  need  to  be  reconstructed  in  MRI  because  the 
data  acquisition  actually  samples  the  spatial  frequency  spec¬ 
trum  or  the  Fourier-transformed  representation  of  the  image 
rather  than  the  image  itself.  A  single  MR  signal,  such  as  a 
measurement  comprising  256  points  sampled  over  a  4  msec 
time  interval,  typically  samples  one  line  of  the  Fourier  trans¬ 
form  space.  The  number  of  lines  sampled  of  this  space, 
proportional  to  the  total  number  of  Fourier  terms  measured. 
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determines  the  spatial  resolution  of  the  image.  The  spacing 
between  lines  and  samples  is  proportional  to  the  inverse  of 
the  field  of  view  in  that  direction. 

The  interactivity  of  real-time  MRI  is  provided  by  allow¬ 
ing  for  adjustment  of  the  MRI  scanning  parameters  on  the 
basis  of  the  reconstructed  image.  Sometimes  interactive  ad¬ 
justment  is  done  by  the  operator,  while  in  other  instances  it 
might  be  done  automatically  by  an  algorithmic-based  inter¬ 
pretation  of  the  current  image  or  recent  series  of  images. 
One  practical  example  of  operator  control  is  allowance  for 
interactive  adjustment  of  the  plane  of  section.  This  plane  is 
determined  by  the  specific  waveforms  applied  to  the  mag¬ 
netic  gradients  within  the  MRI  pulse  sequence.  For  exam¬ 
ple,  it  may  be  desirable  to  choose  a  slice  which  exactly  cuts 
through  the  left  ventricle  of  the  heart,  a  so-called  “short 
axis”  view.  The  specific  angulation  varies  from  patient  to 
patient.  By  interactively  imaging  and  identifying  structures 
of  the  heart  the  operator  can  direct  the  coordinates  to  a  con¬ 
troller  which  in  turn  generates  the  rotation  matrix  applied  to 
the  gradient  system. 

III.  Hardware  for  real-time  mri 

In  considering  what  hardware  configuration  to  use  for 
real-time  digital  signal  processing  in  MRI  there  are  a  num¬ 
ber  of  important  technical  specifications.  Perhaps  the  first 
of  these  is  speed,  particularly  the  time  required  to  perform  a 
fast  Fourier  transform  (FFT)  because  so  much  of  MR  image 
reconstruction  is  based  on  Fourier  transformation.  How¬ 
ever,  it  is  important  to  note  that  there  are  many  mathemati¬ 
cal  processes  of  interest  beyond  FFTs.  These  include,  for 
example,  regridding  algorithms  [8],  auto-  and  cross¬ 
correlations,  determination  of  magnitude  and  phase  at  each 
pixel,  high  speed  regression  and  curve  fitting,  and  means  for 
combining  sub-images  from  separate  coil  elements.  As  mi¬ 
croprocessor  cycle  frequencies  have  continued  to  increase  in 
the  last  decade,  a  number  of  design  approaches  have  been 
used  successfully.  These  include  systems  in  which  the  re¬ 
construction  is  primarily  performed  using  a  dedicated  array 
processor  [9],  one  or  more  work  stations  [10],  or  an  ap¬ 
proach  using  special  purpose  computational  hardware  [11, 
12].  Indeed,  conceivably  real-time  reconstruction  can  be 
performed  on  contemporary,  high  clock  speed  personal 
computers. 

In  addition  to  processing  speed,  other  important  specifi¬ 
cations  include:  (i)  flexibility  of  the  input  port  of  the  recon¬ 
struction  system;  (ii)  system  latency;  and  (iii)  memory  size 
and  addressing.  The  first  of  these  pertains  to  how  readily 
the  reconstruction  system  can  accommodate  data  which  may 
have  been  acquired  using  different  sampling  trajectories  in 
Fourier  transform  or  “k”  space.  For  example,  a  one¬ 
dimensional  1024-point  navigator  echo  may  be  acquired 
only  several  msec  prior  to  a  512-point  spiral-format  image 
echo  with  an  expectation  that  both  be  somehow  recon¬ 
structed  in  real  time.  Within  this  short  timeframe  the  system 
must  be  able  to  account  for  the  different  vector  size  and  k- 
space  format.  System  latency  refers  to  time  delays  within 
the  entire  reconstruction  process,  possibly  due  to  causes 


other  than  execution  of  the  mathematical  algorithm.  One 
example  is  the  delay,  as  might  be  due  to  data  transfer,  be¬ 
tween  the  time  of  digitization  of  the  data  and  the  time  at 
which  the  reconstruction  of  that  data  commences.  Another 
possible  latency  is  the  time  delay  between  completion  of  re¬ 
construction  of  an  image  and  the  time  that  image  is  first  dis¬ 
played  to  the  operator.  Latency  becomes  particularly  impor¬ 
tant  when  the  initiation  of  some  process  depends  critically 
upon  what  is  observed  in  the  reconstructed  image  sequence. 
One  example  of  this  is  fluoroscopically-triggered  contrast- 
enhanced  MR  angiography  [13].  Memory  size  and  address¬ 
ing  become  particularly  relevant  for  methods  in  which  large 
amounts  of  data  are  accumulated  for  processing,  such  as 
functional  neuro  MRI  and  3D  imaging,  or  for  techniques 
which  use  partial  k-space  updating.  For  research  environ¬ 
ments  it  is  clearly  desirable  to  have  ease  of  programmabil¬ 
ity. 

IV.  Applications  of  real-time  mri 

Real-time  signal  processing  methods  can  be  illustrated 
by  a  number  of  emerging  applications. 

A.  MR  Fluoroscopy 

This  term  refers  to  continuous  real-time  MR  imaging 
[14]  as  might  be  used  to  facilitate  the  setup  or  acquisition  of 
high  quality,  diagnostic  images.  It  is  analogous  to  the  use  of 
x-ray  fluoroscopy  which  serves  a  similar  purpose  in  x-ray 
based  imaging.  In  some  sense  this  is  the  most  direct  appli¬ 
cation  of  real-time  signal  processing  in  that  image  recon¬ 
struction  is  performed  as  the  data  are  acquired,  and  the  op¬ 
erator  contols  the  plane  of  section  based  on  the  sequence  of 
displayed  images.  In  an  early  demonstration  with  gradient 
echo  acquisition  the  real-time  capability  was  shown  to  re¬ 
duce  by  almost  an  order  of  magnitude  the  time  required  to 
localize  specific  sections  of  the  left  ventricle  [15].  Using 
spiral  trajectories,  imaging  rates  as  high  as  10  Hz  have  been 
achieved,  and  this  has  been  used  for  cardiac  imaging  in  pa¬ 
tients  who  have  been  poor  candidates  for  echocardiography 
[16]. 

B.  Real-Time  Navigator  Echoes 

The  term  “navigator”  echo  refers  to  an  MR  signal  meas¬ 
ured  to  monitor  the  motion  of  an  object  during  the  course  of 
the  acquisition  of  the  image  data  [17].  It  was  originally  de¬ 
signed  to  allow  for  the  data  to  be  retrospectively  corrected 
for  the  motion  measured  [18].  With  real-time  processing 
techniques,  however,  it  is  possible  to  use  the  navigator  echo 
to  adjust  the  acquisition  instantaneously,  within  msec  of  ac¬ 
quisition  [19].  This  can  be  useful  for  imaging  of  the  heart, 
in  which  case  it  is  necessary  to  account  for  both  cardiac  and 
respiratory  motion.  By  restricting  the  data  acquisition  to  the 
diastolic  phase  of  the  cardiac  cycle,  cardiac  motion  can  be 
accounted  for.  By  using  a  navigator  echo  to  monitor  the  su¬ 
perior-inferior  position  of  the  diaphragm,  this  motion  infor¬ 
mation  can  be  used  to  include  or  reacquire  the  accompany¬ 
ing  raw  data  or  even  to  adjust  the  plane  of  excitation  in  an 
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attempt  in  an  attempt  to  track  the  heart  position.  More  re¬ 
cently  navigator  echoes  are  being  acquired  along  specific 
circular  trajectories  in  k-space,  so-called  orbital  navigator 
echoes,  in  order  to  have  a  high  degree  of  sensitivity  to  rota¬ 
tion  [6],  These  are  being  used  in  functional  neuro  MRI,  a 
field  which  is  particularly  prone  to  error  if  the  subject 
moves  during  the  data  acquisition.  Initial  implementation 
allowed  for  rotation  about  one  axis  [20],  but  more  recently 
the  allowance  for  multiaxial  rotations  is  being  measured  and 
corrected  in  real  time  [21]. 

C.  Real-Time  Image-Triggered  MR  Angiography 

A  growing  application  in  MRI  is  the  imaging  of  blood 
vessels  using  an  intravenously  administered  contrast  agent 
[22].  Because  of  the  wide  range  of  transit  times  from  pa¬ 
tient  to  patient  of  the  contrast  bolus  as  it  moves  from  the  ve¬ 
nous  injection  site  to  the  arteries  of  interest,  and  because  of 
the  need  to  accurately  time  the  MR  acquisition  to  the  arterial 
phase  of  the  contrast  bolus,  it  is  necessary  to  determine 
proper  timing  on  a  patient-specific  basis.  One  effective  way 
to  do  this  is  real-time  image  or  “fluoroscopically  triggered” 
contrast-enhanced  MR  angiography  [23].  With  this  tech¬ 
nique  good  spatial  resolution  2D  images  are  acquired  of  the 
targetted  arterial  anatomy  in  real  time  at  rates  of  1-2  Hz  af¬ 
ter  the  contrast  material  has  been  injected.  Upon  visualiza¬ 
tion  of  contrast  arrival  in  the  targetted  vessels,  the  operator 
triggers  the  very  high  resolution  3D  scan  by  mouse  click. 
This  technique  has  proven  to  be  highly  reliable  in  capturing 
the  desired  arterial  phase  for  blood  vessels  from  the  neck  to 
the  pelvis  [24].  Real-time  signal  processing  methods  used 
are  high  speed  reconstruction,  interactive  localization,  and 
instantaneous  switching  between  2D  and  3D  pulse  se¬ 
quences. 

D.  Interactive  Fast-Spin-Echo  Imaging 

Yet  another  emerging  application  of  real-time  MRI 
techniques  is  the  use  of  RARE  [4]  or  fast-spin-echo  imaging 
on  an  interactive  basis.  When  implemented  as  a  single  shot 
approach  all  of  the  desired  k-space  data  are  read  out  in  one 
excitation  cycle.  Recently  this  method  has  been  incorpo¬ 
rated  with  real-time  reconstruction  and  parameter  control  to 
allow  interactive  imaging  [25].  As  part  of  this,  the  tech¬ 
nique  of  driven  equilibrium  has  been  used  to  maintain  high 
SNR,  even  for  TR  times  of  2000  msec  or  less,  and  Wiener 
demodulation  has  been  incorporated  to  restore  spatial  reso¬ 
lution  loss  due  to  T2  modulation.  The  resultant  interactive 
spin-echo  method  is  currently  being  used  in  studies  of  the 
pelvic  floor,  for  fetal  imaging,  and  improved  methods  for 
MR  cholangiopancreatography  (MRCP). 

V.  Discussion 

Signal  processing  methods  are  critical  in  virtually  all  of 
the  stages  of  the  process  of  MRI  data  acquisition  and  image 
formation.  As  advances  in  MRI  physics  in  the  last  two  dec¬ 
ades  have  permitted  acquisition  times  for  MR  imaging  to  be 
progressively  reduced  from  minutes  to  the  order  of  seconds, 


it  has  become  necessary  to  speed  up  the  signal  processing  to 
make  efficient  use  of  the  moe  rapidly  acquired  data.  Fur¬ 
thermore,  real-time  signal  processing  can  permit  specific 
applications  of  MRI  which  would  not  be  possible  otherwise. 
These  are  often  designed  to  exploit  the  vast  flexibility  of 
contrast  of  MRI  and  to  tune  the  acquisition  on  a  patient- 
specific  basis.  As  the  range  of  applications  continues  to 
grow,  particularly  interactive  MRI  techniques,  real-time 
signal  processing  will  become  even  more  sophisticated  and 
common. 

VI.  Conclusion 

Real-time  MRI  signal  processing  techniques  are  growing 
in  importance  in  allowing  expanded  applications  of  MRI  as 
well  as  improved  reliability  by  allowance  for  patient- 
specific  characteristics. 
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